DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information
  1. Laue-DIALS: Open-source software for polychromatic x-ray diffraction data

    Most x-ray sources are inherently polychromatic. Polychromatic (“pink”) x-rays provide an efficient way to conduct diffraction experiments as many more photons can be used and large regions of reciprocal space can be probed without sample rotation during exposure—ideal conditions for time-resolved applications. Analysis of such data is complicated, however, causing most x-ray facilities to discard >99% of x-ray photons to obtain monochromatic data. Key challenges in analyzing polychromatic diffraction data include lattice searching, indexing and wavelength assignment, correction of measured intensities for wavelength-dependent effects, and deconvolution of harmonics. We recently described an algorithm, Careless, that can perform harmonic deconvolution andmore » correct measured intensities for variation in wavelength when presented with integrated diffraction intensities and assigned wavelengths. Here, we present Laue-DIALS, an open-source software pipeline that indexes and integrates polychromatic diffraction data. Laue-DIALS is based on the dxtbx toolbox, which supports the DIALS software commonly used to process monochromatic data. As such, Laue-DIALS provides many of the same advantages: an open-source, modular, and extensible architecture, providing a robust basis for future development. We present benchmark results showing that Laue-DIALS, together with Careless, provides a suitable approach to the analysis of polychromatic diffraction data, including for time-resolved applications.« less
  2. ExaFEL: extreme-scale real-time data processing for X-ray free electron laser science

    ExaFEL is an HPC-capable X-ray Free Electron Laser (XFEL) data analysis software suite for both Serial Femtosecond Crystallography (SFX) and Single Particle Imaging (SPI) developed in collaboration with the Linac Coherent Lightsource (LCLS), Lawrence Berkeley National Laboratory (LBNL) and Los Alamos National Laboratory. ExaFEL supports real-time data analysis via a cross-facility workflow spanning LCLS and HPC centers such as NERSC and OLCF. Our work therefore constitutes initial path-finding for the US Department of Energy's (DOE) Integrated Research Infrastructure (IRI) program. We present the ExaFEL team's 7 years of experience in developing real-time XFEL data analysis software for the DOE's exascalemore » supercomputers. We present our experiences and lessons learned with the Perlmutter and Frontier supercomputers. Furthermore we outline essential data center services (and the implications for institutional policy) required for real-time data analysis. Finally we summarize our software and performance engineering approaches and our experiences with NERSC's Perlmutter and OLCF's Frontier systems. This work is intended to be a practical blueprint for similar efforts in integrating exascale compute resources into other cross-facility workflows.« less
  3. Deep residual networks for crystallography trained on synthetic data

    The use of artificial intelligence to process diffraction images is challenged by the need to assemble large and precisely designed training data sets. To address this, a codebase called Resonet was developed for synthesizing diffraction data and training residual neural networks on these data. Here, two per-pattern capabilities of Resonet are demonstrated: (i) interpretation of crystal resolution and (ii) identification of overlapping lattices. Resonet was tested across a compilation of diffraction images from synchrotron experiments and X-ray free-electron laser experiments. Crucially, these models readily execute on graphics processing units and can thus significantly outperform conventional algorithms. While Resonet is currentlymore » utilized to provide real-time feedback for macromolecular crystallography users at the Stanford Synchrotron Radiation Lightsource, its simple Python-based interface makes it easy to embed in other processing frameworks. This work highlights the utility of physics-based simulation for training deep neural networks and lays the groundwork for the development of additional models to enhance diffraction collection and analysis.« less
  4. Real‐time XFEL data analysis at SLAC and NERSC: A trial run of nascent exascale experimental data analysis

    X‐ray scattering experiments using free electron lasers (XFELs) are a powerful tool to determine the molecular structure and function of unknown samples (such as COVID‐19 viral proteins). XFEL experiments are a challenge to computing in two ways: (i) due to the high cost of running XFELs, a fast turnaround time from data acquisition to data analysis is essential to make informed decisions on experimental protocols; (ii) data‐collection rates are growing exponentially, requiring new scalable algorithms. Here we report our experiences analyzing data from two experiments at the Linac Coherent Light Source (LCLS) during September 2020. Raw data were analyzed onmore » NERSC's Cori XC40 system, using the Superfacility paradigm: our workflow automatically moves raw data between LCLS and NERSC, where it is analyzed using the software package CCTBX. We achieved real time data analysis with a turnaround time from data acquisition to full molecular reconstruction in as little as 10 min—sufficient time for the experiment's operators to make informed decisions. By hosting the data analysis on Cori, and by automating LCLS‐NERSC interoperability, we achieved a data analysis rate which matches the data acquisition rate. Completing data analysis within 10 min is a first for XFEL experiments and an important milestone if we are to keep up with data‐collection trends.« less
  5. Accelerating x-ray tracing for exascale systems using Kokkos

    The upcoming exascale computing systems Frontier and Aurora will draw much of their computing power from GPU accelerators. The hardware for these systems will be provided by AMD and Intel, respectively, each supporting their own GPU programming model. The challenge for applications that harness one of these exascale systems will be to avoid lock-in and to preserve performance portability. We report here on our results of using Kokkos to accelerate a real-world application on NERSC's Perlmutter Phase 1 (using NVIDIA A100 accelerators) and Crusher, the testbed system for OLCF's Frontier (using AMD MI250X). By porting to Kokkos, we successfully ranmore » the same X-ray tracing code on both systems and achieved speed-ups between 13 % and 66 % compared to the original CUDA code. Finally, these results are a highly encouraging demonstration of using Kokkos to accelerate production science code.« less
  6. In Situ Structural Observation of a Substrate- and Peroxide-Bound High-Spin Ferric-Hydroperoxo Intermediate in the P450 Enzyme CYP121

    The P450 enzyme CYP121 from Mycobacterium tuberculosis catalyzes a carbon–carbon (C–C) bond coupling cyclization of the dityrosine substrate containing a diketopiperazine ring, cyclo(l-tyrosine-l-tyrosine) (cYY). An unusual high-spin (S = 5/2) ferric intermediate maximizes its population in less than 5 ms in the rapid freeze-quenching study of CYP121 during the shunt reaction with peracetic acid or hydrogen peroxide in acetic acid solution. Here, we show that this intermediate can also be observed in the crystalline state by EPR spectroscopy. By developing an on-demand-rapid-mixing method for time-resolved serial femtosecond crystallography with X-ray free-electron laser (tr-SFX-XFEL) technology covering the millisecond time domain andmore » without freezing, we structurally monitored the reaction in situ at room temperature. After a 200 ms peracetic acid reaction with the cocrystallized enzyme–substrate microcrystal slurry, a ferric-hydroperoxo intermediate is observed, and its structure is determined at 1.85 Å resolution. The structure shows a hydroperoxyl ligand between the heme and the native substrate, cYY. The oxygen atoms of the hydroperoxo are 2.5 and 3.2 Å from the iron ion. The end-on binding ligand adopts a near-side-on geometry and is weakly associated with the iron ion, causing the unusual high-spin state. This compound 0 intermediate, spectroscopically and structurally observed during the catalytic shunt pathway, reveals a unique binding mode that deviates from the end-on compound 0 intermediates in other heme enzymes. The hydroperoxyl ligand is only 2.9 Å from the bound cYY, suggesting an active oxidant role of the intermediate for direct substrate oxidation in the nonhydroxylation C–C bond coupling chemistry.« less
  7. Chemical crystallography by serial femtosecond X-ray diffraction

    AbstractInorganic–organic hybrid materials represent a large share of newly reported structures, owing to their simple synthetic routes and customizable properties1. This proliferation has led to a characterization bottleneck: many hybrid materials are obligate microcrystals with low symmetry and severe radiation sensitivity, interfering with the standard techniques of single-crystal X-ray diffraction2,3 and electron microdiffraction4–11. Here we demonstrate small-molecule serial femtosecond X-ray crystallography (smSFX) for the determination of material crystal structures from microcrystals. We subjected microcrystalline suspensions to X-ray free-electron laser radiation12,13 and obtained thousands of randomly oriented diffraction patterns. We determined unit cells by aggregating spot-finding results into high-resolution powder diffractograms. Aftermore » indexing the sparse serial patterns by a graph theory approach14, the resulting datasets can be solved and refined using standard tools for single-crystal diffraction data15–17. We describe the ab initio structure solutions of mithrene (AgSePh)18–20, thiorene (AgSPh) and tethrene (AgTePh), of which the latter two were previously unknown structures. In thiorene, we identify a geometric change in the silver–silver bonding network that is linked to its divergent optoelectronic properties20. We demonstrate that smSFX can be applied as a general technique for structure determination of beam-sensitive microcrystalline materials at near-ambient temperature and pressure.« less
  8. Structural dynamics in the water and proton channels of photosystem II during the S2 to S3 transition

    Abstract Light-driven oxidation of water to molecular oxygen is catalyzed by the oxygen-evolving complex (OEC) in Photosystem II (PS II). This multi-electron, multi-proton catalysis requires the transport of two water molecules to and four protons from the OEC. A high-resolution 1.89 Å structure obtained by averaging all the S states and refining the data of various time points during the S 2 to S 3 transition has provided better visualization of the potential pathways for substrate water insertion and proton release. Our results indicate that the O1 channel is the likely water intake pathway, and the Cl1 channel is the likelymore » proton release pathway based on the structural rearrangements of water molecules and amino acid side chains along these channels. In particular in the Cl1 channel, we suggest that residue D1-E65 serves as a gate for proton transport by minimizing the back reaction. The results show that the water oxidation reaction at the OEC is well coordinated with the amino acid side chains and the H-bonding network over the entire length of the channels, which is essential in shuttling substrate waters and protons.« less
  9. Observations of phase changes in monoolein during high viscous injection

    Serial crystallography of membrane proteins often employs high-viscosity injectors (HVIs) to deliver micrometre-sized crystals to the X-ray beam. Typically, the carrier medium is a lipidic cubic phase (LCP) media, which can also be used to nucleate and grow the crystals. However, despite the fact that the LCP is widely used with HVIs, the potential impact of the injection process on the LCP structure has not been reported and hence is not yet well understood. The self-assembled structure of the LCP can be affected by pressure, dehydration and temperature changes, all of which occur during continuous flow injection. These changes tomore » the LCP structure may in turn impact the results of X-ray diffraction measurements from membrane protein crystals. To investigate the influence of HVIs on the structure of the LCP we conducted a study of the phase changes in monoolein/water and monoolein/buffer mixtures during continuous flow injection, at both atmospheric pressure and under vacuum. The reservoir pressure in the HVI was tracked to determine if there is any correlation with the phase behaviour of the LCP. The results indicated that, even though the reservoir pressure underwent (at times) significant variation, this did not appear to correlate with observed phase changes in the sample stream or correspond to shifts in the LCP lattice parameter. During vacuum injection, there was a three-way coexistence of the gyroid cubic phase, diamond cubic phase and lamellar phase. During injection at atmospheric pressure, the coexistence of a cubic phase and lamellar phase in the monoolein/water mixtures was also observed. The degree to which the lamellar phase is formed was found to be strongly dependent on the co-flowing gas conditions used to stabilize the LCP stream. A combination of laboratory-based optical polarization microscopy and simulation studies was used to investigate these observations.« less
  10. Beyond integration: modeling every pixel to obtain better structure factors from stills

    Most crystallographic data processing methods use pixel integration. In serial femtosecond crystallography (SFX), the intricate interaction between the reciprocal lattice point and the Ewald sphere is integrated out by averaging symmetrically equivalent observations recorded across a large number (104-106) of exposures. Although sufficient for generating biological insights, this approach converges slowly, and using it to accurately measure anomalous differences has proved difficult. This report presents a novel approach for increasing the accuracy of structure factors obtained from SFX data. A physical model describing all observed pixels is defined to a degree of complexity such that it can decouple the variousmore » contributions to the pixel intensities. Model dependencies include lattice orientation, unit-cell dimensions, mosaic structure, incident photon spectra and structure factor amplitudes. Maximum likelihood estimation is used to optimize all model parameters. The application of prior knowledge that structure factor amplitudes are positive quantities is included in the form of a reparameterization. The method is tested using a synthesized SFX dataset of ytterbium(III) lysozyme, where each X-ray laser pulse energy is centered at 9034 eV. This energy is 100 eV above the Yb3+L-III absorption edge, so the anomalous difference signal is stable at 10 electrons despite the inherent energy jitter of each femtosecond X-ray laser pulse. This work demonstrates that this approach allows the determination of anomalous structure factors with very high accuracy while requiring an order-of-magnitude fewer shots than conventional integration-based methods would require to achieve similar results.« less
...

Search for:
All Records
Creator / Author
"Mendez, Derek"

Refine by:
Article Type
Availability
Journal
Creator / Author
Publication Date
Research Organization